Enquêter. Rater. Enquêter encore. Rater encore. Rater mieux

On Rater Agreement and Rater Training

This paper first analyzed two studies on rater factors and rating criteria to raise the problem of rater agreement. After that the author reveals the causes of discrepencies in rating administration by discussing rater variability and rater bias. The author argues that rater bias can not be eliminated completely, we can only reduce the error to a cetain degree by training raters. The study on r...

Rater Effects as a Function of Rater Training Context

This study examined the influence of rater training and scoring context on the manifestation of rater effects in a group of trained raters. 120 raters participated in the study and experienced one of three training/scoring contexts: (a) online training in a distributed scoring context, (b) online training in a regional scoring context, and (c) stand-up training in a regional context. After trai...

Rater agreement in emerging psychosis

An Examination of Variation in Rater Severity Over Time: A Study in Rater Drift

Ratings on performance tasks from two scoring sessions of an eighth grade mathematics examination, developed by the California State Department of Education, were used (a) to study the feasibility of estimating IRT rater severity information within a scoring session, (b) to investigate the variation in rater severity within rating sessions (which we called rater drift), and (c) to examine the r...

Intra-rater and inter-rater reliability of the portable gait rhythmogram in post-stroke patients

[Purpose] Gait analysis, such as portable gait rhythmogram (PGR) provides objective information that helps in the quantitative evaluation of human locomotion. The purpose of this study was to assess the reliability of PGR in post-stroke patients. [Subjects and Methods] Two raters (A and B) examined 44 post-stroke patients. To assess intra-rater reliability, rater A tested subjects on three sepa...